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MSM in Coastal Kenya 

Elizabeth Wahome 3 , Greg Fegan a ' b , Haile S. Okuku 3 , 
Peter Mugo a , Matthew A. Price c , Grace Mwashigadi 3 , 
Alexander Thiong'c/, Susan M. Graham a,d and Eduard 
J. Sanders a ' b 

We evaluated the University of North Carolina- 
Malawi Risk Screening Score (UMRSS) for detec- 
tion of acute and early HIV-1 infection (AEHI) in a 
cohort of Kenyan MSM with approximately 8% 
annual HIV-1 incidence. Three components of 
the UMRSS (fever, diarrhea, and discordant rapid 
HIV tests) were also independent predictors of 
AEHI in our cohort. The predictive ability (area 
under the receiver operating characteristic curve, 
AUC) of the UMRSS was 0.79. A cohort-derived 
risk score consisting of six characteristics (fever, 
diarrhea, discordant rapid HIV tests, fatigue, age 
<30 years, and symptomatic sexually transmitted 
disease) had a higher AUC of 0.85. Screening for 
AEHI will have substantial transmission prevention 
benefits. 

MSM have among the highest HIV-1 incidence in sub- 
Saharan Africa, but targeted interventions for HIV-1 
testing ofMSM are mostly lacking [1-3]. When HIV-1 is 
acquired, patients may frequently seek urgent healthcare 
for symptoms, including fever or unconfirmed 'malaria' 
[4—6], and become extremely infectious during a short 
period of 3—4 weeks (acute HIV infection; AHI) and 
highly contagious during the first 6 months (early HIV-1 
infection) [7,8]. However, diagnosing acute and early 
HIV-1 infection (AEHI) remains challenging in resource- 
limited settings, in part due to a lack of low-cost, point- 
of-care tests for nucleic acid detection [9] . In Malawi, the 
UNC Malawi Risk Screening Score (UMRSS) com- 
bining discrete clinical and behavioral characteristics 
has been developed to identify AHI among sexually 
transmitted diseases (STDs) clinic patients [10]. In this 
study, STD patients who were HIV-1 negative or had 
discordant rapid HIV tests received a score of 1 for fever, 
body ache, and more than one partner; 2 for diarrhea and 
genital ulcer disease (GUD); and 4 for discordant rapid 
tests. Using this algorithm, Powers et at [10] could 
identify 95% of the AHI cases identified by targeted 
testing of only patients with a score of 2 or greater (40% of 
the population studied). As MSM frequently present with 
an STD, we wanted to validate this UMRSS in our 
MSM cohort in Coastal Kenya, and compare it to a 



cohort-derived risk screening score (CDRSS) using our 
own data and similar methodology. 

Since 2005, we have enrolled HIV-seronegative MSM in 
a cohort study of HIV-1 acquisition, as previously 
described [1]. Men made either monthly or quarterly 
scheduled visits at which risk reduction counseling was 
provided and a medical history and physical examination 
was performed. HIV-1 seroconversion was diagnosed 
using two rapid test kits (Determine, Abbott Labora- 
tories, Abbott Park, Illinois, USA; Unigold, Trinity 
Biotech pic, Bray, Ireland) in parallel. Patients with 
discordant rapid HIV-1 test results were retested until 
discordancy was resolved. All seronegative and discor- 
dant samples were tested for p24 antigen (Vironostika 
HIV-1 p24 ELISA, Biomerieux, Ltd, Marcy l'Etoile, 
France). Up to 1 January 2012, preseroconversion and 
postseroconversion plasma samples were tested for HIV-1 
RNA level (Amplicor Monitor, version 1.5; Roche, 
Branchburg, New Jersey, USA) with a positive result 
defined as more than 400 copies/ml [1]. All HIV 
diagnoses were confirmed by a positive RNA level 
{n = 67) or by follow-up until both rapid tests were 
positive (n = 6). 

An AEHI visit was defined as a visit with an antibody 
seroconversion (determined by two positive rapid HIV 
tests), serodiscordant rapid HIV tests (one rapid test 
positive, one rapid test negative), or positive p24 antigen 
test. Eighteen (90%) of 20 patients with a positive p24 
antigen test were clinically evaluated within 1 week of the 
test result [1]. 

HIV-1 incidence was estimated at 7.5% (95% confidence 
interval 6.0—9.5) per 100 person years during the study 
period. The median number of days from estimated date 
of HIV-1 infection to evaluation was 39 (interquartile 
range 19—59). At their AEHI visit, 42 patients had a rapid 
antibody seroconversion (after a documented seronega- 
tive result at the last study visit), 11 had a serodiscordant 
rapid HIV test, and 20 had a positive p24 antigen test. 
Characteristics reported (including symptoms experi- 
enced since the last study visit) at 73 AEHI visits were 
compared with characteristics reported at 6458 scheduled 
cohort visits (Table 1). 



Cohort-derived risk screening score 

To identify predictors of AEHI in our MSM cohort, 
we calculated unadjusted prevalence odds ratios for 
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sociodemographic, medical history, and physical exami- 
nation findings with AEHI as an outcome. We compared 
characteristics reported at AEHI visits to those reported 
at all seronegative visits, using generalized estimating 
equation (GEE) to adjust for intraindividual correlation. 
We constructed separate models for two specific domains 
(i.e. symptoms reported in past months and clinical 
examination findings) , similar to the approach of Powers 
et al. [10]. Characteristics associated with AEHI at 
P<0.05 were included in initial multivariable models 
for two domains: 'symptom' and 'clinical examination' 
findings. We constructed a full, combined model 
including discordant rapid test results, age, fever, and 
the variables from the reduced, domain-specific models. 
Fever (or a history of having received treatment for 
unconfirmed 'malaria') was included a priori as this was 
the most significant reason for care seeking prior to 
seroconversion in our cohort [4]. The final model 
retained only predictors associated with AEHI at P < 0.05 
in the combined model. Data for men who seroconverted 
were censored at the AEHI visit. 



Comparison of cohort-derived risk 
screening score with University of North 
Carolina-Malawi Risk Screening Score 

Similar to Powers' approach, we assigned each variable in 
the final cohort-derived model a predictor score equal to 
its (3 coefficient (natural log of the adjusted prevalence 
odds ratio) from the GEE model, rounded to the nearest 
integer (Table 1). Independent predictors for HIV-1 
acquisition included in the CDRSS and their corre- 
sponding predictor scores were 1 for fever, fatigue, any 
symptomatic STD, diarrhea or age less than 30 years; and 
4 for discordant HIV tests. The maximum score possible 
using the CDRSS was 9. Predictors in the UMRSS are 
shown in the last column of the Table 1 and can sum to 
11 [10]. We selected the CDRSS cut-off point that 
optimized sensitivity, specificity, and positive predictive 
values (details in the supplemental figure, http:// 
links.lww.com/QAD/A356) and compared our results 
with UMRSS results. We calculated the AUC for the 
predictive ability of each score to identify a patient visit at 
which AEHI was diagnosed. 

The UMRSS with a cut-off point at 2 had a sensitivity of 
75.3%, specificity of 76.4%, and positive predictive value 
of 3.5% to identify AEHI correctly in our study 
population. Corresponding values for the CDRSS with 
a cut-off point at 2 were 80.8%, 76.0%, and 3.7%, 
respectively. The AUCs for the UMRSS and the CDRSS 
were 0.79 and 0.85, respectively (P< 0.009). When we 
restricted the CDRSS to include only age less than 
30 years, fever, or any symptomatic STD, the AUC 
became 0.77 (not different from the UMRSS). 



To our knowledge, this is the first time that the UMRSS 
has been validated outside Malawi. Three of the six 
UMRSS characteristics (history of fever, diarrhea, and 
discordant rapid HIV tests) identified AEHI indepen- 
dently in our MSM population, and so were included in 
the CDRSS. The CDRSS had a better performance 
when all six predictors of AEHI in our cohort were 
included (additional characteristics: fatigue, age <30 years, 
and symptomatic STD) . Interestingly, a simplified CDRSS 
including only three characteristics (age <30 years, fever, 
and any symptomatic STD) had a similar performance to 
the UMRSS. 

Study limitations include possible ascertainment bias if 
patients overreported symptoms at their AEHI visit due to 
a seroconversion diagnosis, and the fact that we derived our 
validation from a very high-risk MSM population followed 
in a research setting. Although GUD was a predictor of 
AEHI in the study by Powers et al. [10], GUD was 
uncommon in this MSM population [1]. Fatigue was not a 
predictor of AEHI in STD patients in Malawi, but was 
frequently reported by our population and by men (but not 
women) in a large study of primary HIV-1 infection [11]. 

In summary, our study confirmed the importance of 
fever, diarrhea, and discordant HIV test results for the 
identification of AEHI in African populations, and 
demonstrated that targeted screening for AEHI in MSM 
could be performed using a CDRSS consisting of a 
limited set of characteristics, including age younger than 
30 years, fever, diarrhea, fatigue, any symptomatic STD, 
and discordant HIV test results. Such screening for AEHI, 
when supported by risk reduction counseling and 
combination prevention therapy, will have substantial 
transmission prevention benefits [3]. 
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Realtime adherence monitoring of antiretroviral 
therapy among HIV-infected adults and children in 
rural Uganda 

Jessica E. Haberer a ' b ' c , Julius Kiwanuka d , Denis Nan- 
sera d , Conrad Muzoora d , Peter W. Hunt 6 , Jacquelyn 
So e , Michael O'Donnell 3 , Mark Siedner 3 , Jeffrey N. 
Martin 6 and David R. Bangsberg a ' b ' c d 

A real-time wireless electronic adherence monitor 
(EAM) and weekly self-report of missed doses via 
interactive voice response (IVR) and short message 
service (SMS) queries were used to measure anti- 
retroviral therapy adherence in 49 adults and 46 
children in rural Uganda. Median adherence was 
89.5% among adults and 92.8% among children by 
EAM, and 99-100% for both adults and children by 
IVR/SMS self-report. Loss of viral suppression was 
significantly associated with adherence by EAM 
(odds ratio 0.58 for each 10% increase), but not 
IVR/SMS. Wireless EAM creates an exciting 
opportunity to monitor and potentially intervene 
with adherence challenges as they are happening. 

Traditional antiretroviral therapy (ART) adherence 
assessments include self-report, pill counts, electronic 
monitoring, and drug levels [1]. These measures typically 
detect adherence challenges after HIV viral suppression 
has been lost and possibly after drug resistance has 
developed. Real-time, wireless monitoring strategies 
could identify adherence challenges before the loss of viral 
suppression, thus sustaining the effectiveness of first-line 
regimens [2]. Experience with real-time adherence 
monitoring in developing settings to date has been 
limited to proof-of-concept studies [3,4]. 

This manuscript presents data on the feasibility, validity, 
and acceptability of real-time adherence monitoring 
among adults and children in rural Uganda using a 
wireless electronic adherence monitor (EAM) called 
Wisepill and self-reported missed doses via interactive 
voice response (IVR) and short message service (SMS). 
Ethical approval was obtained from Partners Healthcare, 
Mbarara University of Science and Technology, and the 
Uganda National Council for Science and Technology. 
Participants were enrolled by convenience from two 
longitudinal, observational cohorts: the Ugandan AIDS 
Rural Treatment Outcomes Study (NCT01 596322) and 
Children's ART Adherence Study (NCT00868257). 
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Wisepill wirelessly transmits a date-time stamp with each 
opening using general packet radio service. Data are 
stored for later transmission if network access is 
temporarily unavailable. 

Adults and caregivers of children were offered their 
choice of IVR or SMS for weekly queries of missed doses 
in their local language. Successful responses required 
confirmation of a person identification number and 
receipt of a numeric response. Queries were repeated 
multiple times, if needed. 

Plasma HIV RNA levels were determined at baseline and 
6 months (lower detection limit of 400 copies/ml). 

After 1 month, adults and caregivers were asked 'How 
would you describe using the Wisepill medication 
container?' and 'How do you feel about someone 
monitoring how you are taking your medicine every day?'. 

Associations between loss of viral suppression at 6 months 
and percentage adherence during the prior month were 
determined by logistic regression. The 6-month time 
point was used for both adults and children to ensure 
uniform exposure to the adherence measures and allow 
for habituation to monitoring [5] . Given similar findings, 
data from adults and children were analyzed together, and 
data for IVR and SMS were analyzed together. 
Categories of average adherence were compared with 
loss of viral suppression by Fisher's exact test [6]. Wireless 
EAM and IVR/SMS-reported adherence were compared 
by Spearman correlation. Participants with missing data 
were excluded from analysis. 

Forty-nine adults and 46 children were enrolled. Among 
adults, median age was 37 years [interquartile range 
(IQR) 32—43]; 77.6% were women. At enrollment, 
median CD4 cell count was 299 cells/|xl (IQR 246-392), 
median duration of ART was 15 months (IQR 11-19), 
and 43 participants (87.8%) had undetectable HIV RNA. 
Among children, median age was 7 years (IQR 4—8); 44% 
were female. At enrollment, median CD4 percentage 
was 38 (IQR 30—48), median duration of ART was 
32 months (IQR 18-48), and 20 (43.4%) had 
undetectable HIV RNA. All but two participants were 
taking twice daily nonnucleoside reverse transcriptase 
inhibitor-based ART. 

Adult participants were followed for 53.6 person-years 
(median 14 months per participant); children were 
followed for 22.8 person-years (median 6 months per 
participant). Follow-up periods differed due to distinct 
funding mechanisms. No participants were lost; one 
adult died. 

Median adherence by wireless EAM was 89.5% (IQR 
83.9-92.3%) among adults and 92.8% (IQR 89.2- 
94.6%) among children. 



Five adults (10.2%) and 15 caregivers of children (32.6%) 
received SMS adherence queries. Median percentage of 
successful responses was 86.5% (IQR 48.5-87.9%) for 
adults and 84.5% (IQR 66.5-94.1%) for caregivers. 
Median self-reported adherence by SMS was 100% (IQR 
99.6-100%) for adults and 100% (IQR 99.1-100%) 
for children. 

Thirty-nine adults (79.6%) and 30 caregivers (65.2%) 
received IVR adherence queries. Median percentage of 
successful responses was 65.0% (IQR 10.0—94.7%) for 
adults, and 76.1% (IQR 50.8-88.2%) for caregivers. 
Median adherence was 99.0% (IQR 96.5-100%) for 
adults and 100% (99.8-100%) for children. 

HIV RNA was missing for four adults and four children. 
Three adults and three children lost viral suppression (7.0 
and 15.0% of participants with baseline viral suppression, 
respectively). Percentage adherence by wireless EAM was 
significantly associated with loss of viral suppression (OR 
0.58 for each 10% increase in adherence, IQR 0.34-0.98; 
P=0.04). Percentage adherence by IVR/SMS-report 
was not associated with loss of viral suppression (OR 1.7, 
0.2-15.9; P=0.64) or adherence by wireless EAM 
(f = 0.11, P=0.35). Loss of viral suppression was 
significantly associated with categories of average 
adherence with wireless EAM (P=0.02), but not 
IVR/SMS-report (P=0.54; Fig. 1). 

All but two participants (97.9%) reported Wisepill was 
'easy/very easy' to use. All stated they 'liked/really liked' 
being monitored. 

Real-time wireless electronic adherence monitoring is 
feasible, valid, and acceptable for HIV-infected adults and 
children in a rural African setting. Although IVR was 
preferred over SMS, self-reported adherence was less 
feasible by IVR compared with SMS; neither was a valid 
measure of adherence. 

Wireless EAM has several limitations. First, it is currently 
prohibitively expensive for routine care at $185 per device. 
Significant cost reductions, however, could be achieved 
through mass production. Second, several technical 
problems were encountered, including failed data trans- 
mission and inadequate battery life. Technical limitations at 
the time of data collection prevented quantification of 
these problems, which may have affected the adherence 
assessments. Multiple improvements have since been made, 
including SMS for back-up data transmission [7] and a daily 
'heartbeat' to indicate battery life, device airtime, and signal 
strength. Third, dedicated data personnel are required to 
manage this real-time adherence monitoring system, 
potentially limiting scalability. 

The high adherence seen with self-report by IVR and 
SMS is consistent with traditional forms of self-reported 
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<80% 

N (Wireless EAM) = 12 
N (IVR and SMS) = 3 



80.1-90% 90.1-95% 
Average adherence 

19 12 
4 5 



Wireless EAM 



/, IVR and SMS 



95.1-100% 



43 
62 



Fig. 1 . Loss of viral suppression and adherence. Loss of viral suppression was significantly associated with categories of average 
adherence by wireless electronic adherence monitor (EAM; P=0.02), but not by interactive voice response (IVR) and short 
message service (SMS; P = 0.54). 



adherence [8]. Although the relative anonymity of 
technology-assisted adherence reporting could decrease 
social desirability bias [9] and frequent reporting could 
decrease recall bias, data in this study do not support using 
IVR and SMS for adherence assessment. 

Real-time wireless adherence monitoring creates a 
unique and exciting opportunity to potentially intervene 
with adherence challenges as they are happening and thus 
prolong the effectiveness of inexpensive and accessible 
first-line therapies. Such efficiencies are especially 
important given current economic constraints and 
consideration of treatment for many, if not all, of the 
34 million people living with HIV [10]. 
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